Skip to content

Publish UI test checks for comment triggers#866

Merged
Kyle-Ye merged 1 commit into
mainfrom
codex/uitest-check-runs
May 17, 2026
Merged

Publish UI test checks for comment triggers#866
Kyle-Ye merged 1 commit into
mainfrom
codex/uitest-check-runs

Conversation

@Kyle-Ye
Copy link
Copy Markdown
Collaborator

@Kyle-Ye Kyle-Ye commented May 17, 2026 •
edited
Loading

Summary

  • Create PR check runs on comment-triggered UI tests so they appear in the PR Checks tab
  • Mark requested platform checks queued immediately from a lightweight prepare job
  • Update the check run to in-progress and final success/failure from the platform job

Validation

  • ruby -e 'require "psych"; Psych.parse_file(".github/workflows/uitests.yml")'
  • git diff --check

Note: actionlint is not installed locally.

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 17, 2026

🤖 Augment PR Summary

Summary: This PR publishes PR check runs for UI tests that are triggered via issue comments, so they appear in the PR “Checks” tab.

Changes:

  • Adds checks: write permission and a lightweight prepare_issue_comment job that validates /uitest … comment triggers.
  • Parses the comment to determine requested platforms (iOS/macOS) and exports outputs (repo/SHA, requested flags, check run IDs).
  • Creates queued check runs for same-repo PRs and links them to the workflow run via details_url.
  • Updates iOS/macOS UI test jobs to depend on the prepare job and use its checkout target.
  • Marks the corresponding check run in_progress when the platform job starts.
  • Completes the check run with success/failure/cancelled based on job.status.

Technical Notes: Fork PRs still run the requested tests, but check run creation is skipped since checks can’t be created against fork SHAs in the base repo.

🤖 Was this summary useful? React with 👍 or 👎

augmentcode[bot]
augmentcode Bot reviewed May 17, 2026
View reviewed changes
Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

@Kyle-Ye Kyle-Ye merged commit 7371deb into main May 17, 2026
5 of 7 checks passed
@Kyle-Ye Kyle-Ye deleted the codex/uitest-check-runs branch May 17, 2026 17:53
@codecov
Copy link
Copy Markdown

codecov Bot commented May 17, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 13.79%. Comparing base (e14c750) to head (e299f83).
⚠️ Report is 1 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (e14c750) and HEAD (e299f83). Click for more details.

HEAD has 1 upload less than BASE
Flag BASE (e14c750) HEAD (e299f83)
2 1
Additional details and impacted files 
@@             Coverage Diff             @@
##             main     #866       +/-   ##
===========================================
- Coverage   25.72%   13.79%   -11.93%     
===========================================
  Files         677      637       -40     
  Lines       47008    41270     -5738     
===========================================
- Hits        12092     5695     -6397     
- Misses      34916    35575      +659

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@augmentcode augmentcode[bot] augmentcode[bot] left review comments

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Kyle-Ye